Exact Analytic Solutions for Optimal Control Problems Under Multiplicative Noise
نویسندگان
چکیده
Control-dependent (multiplicative) noise makes it difficult to achieve optimal control because large control signals amplify noise. This paper considers a minimal (one-dimensional) system that includes multiplicative noise and solves the optimal control problem for arbitrary cost functions. In a limit when the control-cost approaches zero, this formulation becomes analytically solvable. The analysis reveals several important properties that are absent in traditional LQ anlysis. In particular, multiplicative noise makes optimal solutions depend on the global features of cost functions.
منابع مشابه
Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems
In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic quadratic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are...
متن کاملA numerical method for some stochastic differential equations with multiplicative noise
Diffusion processes intended to model the continuous state space limit of birth–death processes, chemical reactions, and other discrete particle systems often involve multiplicative noise where the diffusion vanishes near one (or more) of the state space boundaries. Standard direct numerical simulation schemes for the associated stochastic differential equations run the risk of “overshooting”, ...
متن کاملNonlinear differential equations of Riccati type on ordered Banach spaces
In this paper we consider a general class of time-varying nonlinear differential equations on infinite dimensional ordered Banach spaces, which includes as special cases many known differential Riccati equations of optimal control. Using a linear matrix inequalities (LMIs) approach we provide necessary and sufficient conditions for the existence of some global solutions such as maximal, stabili...
متن کاملA moment approach to analytic time-dependent solutions of the Fokker-Planck equation with additive and multiplicative noise
An efficient method is presented as a means of an approximate, analytic timedependent solution of the Fokker-Planck equation (FPE) for the linear Langevin model subjected to additive and multiplicative noise. We have assumed that the dynamical distribution has the same structure as the exact stationary one and that its parameters are expressed in terms of first and second moments, whose equatio...
متن کاملExplicit Solution for Constrained Stochastic Linear-Quadratic Control with Multiplicative Noise
We study in this paper a class of constrained linear-quadratic (LQ) optimal control problem formulations for the scalar-state stochastic system with multiplicative noise, which has various applications, especially in the financial risk management. The linear constraint on both the control and state variables considered in our model destroys the elegant structure of the conventional LQ formulati...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011